Paper to Electronic Questionnaires: Effects on Structured Questionnaire Forms

With the use of computers, paper questionnaires are being replaced by electronic questionnaires. The formats of traditional paper questionnaires have been found to effect a subject's rating. Consequently, the transition from paper to electronic format can subtly change results. The research presented begins to determine how electronic questionnaire formats change subjective ratings. For formats where subjects used a flow chart to arrive at their rating, starting at the worst and middle ratings of the flow charts were the most accurate but subjects took slightly more time to arrive at their answers. Except for the electronic paper format, starting at the worst rating was the most preferred. The paper and electronic paper versions had the worst accuracy. Therefore, for flowchart type of questionnaires, flowcharts should start at the worst rating and work their way up to better ratings

Usability Study of Two Collocated Prototype System Displays

Currently, most of the displays in control rooms can be categorized as status screens, alerts/procedures screens (or paper), or control screens (where the state of a component is changed by the operator). The primary focus of this line of research is to determine which pieces of information (status, alerts/procedures, and control) should be collocated. Two collocated displays were tested for ease of understanding in an automated desktop survey. This usability study was conducted as a prelude to a larger human-in-the-loop experiment in order to verify that the 2 new collocated displays were easy to learn and usable. The results indicate that while the DC display was preferred and yielded better performance than the MDO display, both collocated displays can be easily learned and used

Operator Trust Function for Predicted Drone Arrival

To realize the full benefit from autonomy, systems will have to react to unknown events and uncertain dynamic environments. The resulting number of behaviors is essentially infinite; thus, the system is effectively non-deterministic but an operator needs to understand and trust the actions of the autonomous vehicles. This research began to tackle non-deterministic systems and trust by beginning to develop a user trust function based on intent information displayed and the prescribed bounds on allowable behaviors/actions of the non-deterministic system. Linear regression shows promise on being able to predict a persons confidence of the machines prediction. Linear regression techniques indicated that subject characteristics, scenario difficulty, the experience with the system, and confidence earlier in the scenario account for approximately 60% of the variation in confidence ratings. This paper details the specifics of the liner regression model essentially a trust function for predicting a persons confidence

Effects of historical and predictive information on ability of transport pilot to predict an alert

In the aviation community, the early detection of the development of a possible subsystem problem during a flight is potentially useful for increasing the safety of the flight. Commercial airlines are currently using twin-engine aircraft for extended transport operations over water, and the early detection of a possible problem might increase the flight crew's options for safely landing the aircraft. One method for decreasing the severity of a developing problem is to predict the behavior of the problem so that appropriate corrective actions can be taken. To investigate the pilots' ability to predict long-term events, a computer workstation experiment was conducted in which 18 airline pilots predicted the alert time (the time to an alert) using 3 different dial displays and 3 different parameter behavior complexity levels. The three dial displays were as follows: standard (resembling current aircraft round dial presentations); history (indicating the current value plus the value of the parameter 5 sec in the past); and predictive (indicating the current value plus the value of the parameter 5 sec into the future). The time profiles describing the behavior of the parameter consisted of constant rate-of-change profiles, decelerating profiles, and accelerating-then-decelerating profiles. Although the pilots indicated that they preferred the near term predictive dial, the objective data did not support its use. The objective data did show that the time profiles had the most significant effect on performance in estimating the time to an alert

Uncertainties that flight crews and dispatchers must consider when calculating the fuel needed for a flight

In 1993, fuel accounted for approximately 15 percent of an airline's expenses. Fuel consumption increases as fuel reserves increase because of the added weight to the aircraft. Calculating fuel reserves is a function of Federal Aviation Regulations, airline company policy, and factors that impact or are impacted by fuel usage enroute. This research studied how pilots and dispatchers determined the fuel needed for a flight and identified areas where improvements in methods may yield measurable fuel savings by (1) listing the uncertainties that contribute to adding contingency fuel, (2) obtaining the pilots' and dispatchers' perspective on how often each uncertainty occurred, and (3) obtaining pilots' and dispatchers' perspective on the fuel used for each occurrence. This study found that for the majority of the time, pilots felt that dispatchers included enough fuel. As for the uncertainties that flight crews and dispatchers account for, air traffic control accounts for 28% and weather uncertainties account for 58 percent. If improvements can be made in these two areas, a great potential exists to decrease the reserve required, and therefore, fuel usage without jeopardizing safety

Preliminary Exploration of Adaptive State Predictor Based Human Operator Modeling

Control-theoretic modeling of the human operator dynamic behavior in manual control tasks has a long and rich history. In the last two decades, there has been a renewed interest in modeling the human operator. There has also been significant work on techniques used to identify the pilot model of a given structure. The purpose of this research is to attempt to go beyond pilot identification based on collected experimental data and to develop a predictor of pilot behavior. An experiment was conducted to quantify the effects of changing aircraft dynamics on an operator s ability to track a signal in order to eventually model a pilot adapting to changing aircraft dynamics. A gradient descent estimator and a least squares estimator with exponential forgetting used these data to predict pilot stick input. The results indicate that individual pilot characteristics and vehicle dynamics did not affect the accuracy of either estimator method to estimate pilot stick input. These methods also were able to predict pilot stick input during changing aircraft dynamics and they may have the capability to detect a change in a subject due to workload, engagement, etc., or the effects of changes in vehicle dynamics on the pilot

Collocation and Pattern Recognition Effects on System Failure Remediation

Previous research found that operators prefer to have status, alerts, and controls located on the same screen. Unfortunately, that research was done with displays that were not designed specifically for collocation. In this experiment, twelve subjects evaluated two displays specifically designed for collocating system information against a baseline that consisted of dial status displays, a separate alert area, and a controls panel. These displays differed in the amount of collocation, pattern matching, and parameter movement compared to display size. During the data runs, subjects kept a randomly moving target centered on a display using a left-handed joystick and they scanned system displays to find a problem in order to correct it using the provided checklist. Results indicate that large parameter movement aided detection and then pattern recognition is needed for diagnosis but the collocated displays centralized all the information subjects needed, which reduced workload. Therefore, the collocated display with large parameter movement may be an acceptable display after familiarization because of the possible pattern recognition developed with training and its use

Wetware, Hardware, or Software Incapacitation: Observational Methods to Determine When Autonomy Should Assume Control

Control-theoretic modeling of human operator's dynamic behavior in manual control tasks has a long, rich history. There has been significant work on techniques used to identify the pilot model of a given structure. This research attempts to go beyond pilot identification based on experimental data to develop a predictor of pilot behavior. Two methods for pre-dicting pilot stick input during changing aircraft dynamics and deducing changes in pilot behavior are presented This approach may also have the capability to detect a change in a subject due to workload, engagement, etc., or the effects of changes in vehicle dynamics on the pilot. With this ability to detect changes in piloting behavior, the possibility now exists to mediate human adverse behaviors, hardware failures, and software anomalies with autono-my that may ameliorate these undesirable effects. However, appropriate timing of when au-tonomy should assume control is dependent on criticality of actions to safety, sensitivity of methods to accurately detect these adverse changes, and effects of changes in levels of auto-mation of the system as a whole

Pilot Preferences on Displayed Aircraft Control Variables

The experiments described here explored how pilots want available maneuver authority information transmitted and how this information affects pilots before and after an aircraft failure. The aircraft dynamic variables relative to flight performance were narrowed to energy management variables. A survey was conducted to determine what these variables should be. Survey results indicated that bank angle, vertical velocity, and airspeed were the preferred variables. Based on this, two displays were designed to inform the pilot of available maneuver envelope expressed as bank angle, vertical velocity, and airspeed. These displays were used in an experiment involving control surface failures. Results indicate the displayed limitations in bank angle, vertical velocity, and airspeed were helpful to the pilots during aircraft surface failures. However, the additional information did lead to a slight increase in workload, a small decrease in perceived aircraft flying qualities, and no effect on aircraft situation awareness